To Crowdsource or Not To Crowdsource?
نویسندگان
چکیده
Crowdsourcing contests—events to solicit solutions to problems via an open-call format for prizes—have gained ground as a mechanism for organizations to accomplish tasks. This paper uses game-theoretic models to develop design principles for crowdsourcing contests and answer the questions: what types of tasks should be crowdsourced? Under what circumstances? When a single task is to be completed, crowdsourcing can lead to higher quality outcomes than directed assignment if the pool of players is diverse, but can lead to suboptimal outcomes when workers have similar abilities. With multiple tasks, crowdsourcing can easily match players with diverse skill-sets to different tasks to achieve high aggregate performance. However, surprisingly, crowdsourcing is not always useful to find expert workers for highly specialized tasks.
منابع مشابه
Factors Influencing the Decision to Crowdsource CRIWG 2013 V03Camera
In order to integrate a crowdsourcing strategy to an organization’s business processes, managers need to decide whether or not crowdsourcing is suitable for the organizational context. This study conducted a structured literature review to identify factors related to this decision. These identified factors have been synthesized into a framework for supporting the decision to crowdsource. Based ...
متن کاملNeedle in a Haystack: Reducing the Costs of Annotating Rare-Class Instances in Imbalanced Datasets
Crowdsourced data annotation is noisier than annotation from trained workers. Previous work has shown that redundant annotations can eliminate the agreement gap between crowdsource workers and trained workers. Redundant annotation is usually nonproblematic because individual crowdsource judgments are inconsequentially cheap in a class-balanced dataset. However, redundant annotation on classimba...
متن کاملTour Planning for Crowdsourcing Sensor Data Collection
A disaster surveillance system that crowdsources observation data needs to compute a tour for each volunteer to follow during the data collection process. A common approach to do this computation is to first assign a subset of locations to each volunteer, and then solve the classical traveling salesman problem to find an optimal tour connecting locations in each subset. This paper describes the...
متن کاملRSI-CB: A Large Scale Remote Sensing Image Classification Benchmark via Crowdsource Data
Remote sensing image classification is a fundamental task in remote sensing image processing. In recent years, deep convolutional neural network (DCNN) has seen a breakthrough progress in natural image recognition because of three points: universal approximation ability via DCNN, large-scale database (such as ImageNet), and supercomputing ability powered by GPU. The remote sensing field is stil...
متن کاملSupplementary Documents for “Semi-Crowdsource Clustering: Generalizing Crowd Labeling by Robust Distance Metric Learning”
where T (A′) denotes the space spanned by the elements of the form uky and xv> k , for 1 ≤ k ≤ r, Ω(A′) denotes the space of matrices that have the same support toA′, ‖ ·‖ denotes the spectral norm and ‖ · ‖∞ denotes the largest entry in magnitude. Lemma 1. Let A∗ ∈ RN×N be a similarity matrix of rank r obeying the incoherence properties (A1) and (A2), with μ = max(μ0, μ1). Suppose we observe m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012